Variance of partial sums of stationary sequences 

George Deligiannidis^, and Serg ey Ute^ 

Abstract. Let X\, X2, • • • be a centred sequence of weakly stationary random variables with 
spectral measure F and partial sums S n — X\ + • • • + X n , , and let G(x) = F(dx). We show 
that var(S n ) is regularly varying of index 7 at infinity, if and only if G(x) is regularly varying 
of index 2 — 7 at the origin (0 < 7 < 2). 
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1 Introduction 



Let X\, X 2 , ... be a sequence of centered weakly stationary random variables with finite second 
moments and spectral measure F, such that := cov(Xq, Xk) = J_ e ltk dF(t), where to 
simplify calculations we assume that F is a symmetric measure about the origin and G(x) = 
f* x F(dx). Denote by S n the sequence of partial sums S n = X\ + ■ • • + X n . 
The main result of the paper is the following 



Theorem 1.1. For 7 e (0,2), define C(i) = T(l + 7) sin(77r/2)/[7r(2 - 7)]. Let L(x) be a 
positive function, slowly varying at infinity. Then, 

(i) G(x) ~ C^Kqx 2 ' 1 X(l/ 'x) as x — > if and only if (ii) var(S' n ) ~ Kon'Lin) as n — >■ 00. 
In particular, vax(S n )/n — > K if and only if G(x)/x — > Kq/tt. 



The rate of growth of the variance of the partial sums S n has received considerable attention in 
the literature due its key role in the limit theory of stationary random sequences (see Bradley 
[U Chapter 8] and S amor o dnit sky [T6| Chapter 5] for comprehensive reviews). 

Asymptotically linear behaviour var(5* n ) ~ Kqu. To prove asymptotic normality a common 
restriction on the dependence structure is to assume that the growth var(S' n ) is asymptotically 
linear (Merlevede, Peligrad and Utev [13J). 
For this particular situation, there exist several results which guarantee the convergence of 
var(S' n )/n under sufficient conditions given in terms of mixing coefficients, linear dependence 
coefficients, or in terms of the covariances where it is well-known that if lim ra Y^k=-n -^^o^fc 
exists, then lim n v&r(S n )/n also exists in [0, 00) and the two limits are equal (jU Chapter 5]). 
In terms of the spectral measure F, Ibragimov's [10] result states that when F is absolutely 
continuous, a sufficient condition is the continuity of the spectral density / at the origin, in 
which case lim n v&r(S n )/n = 27r/(0)-this follows from the following representation 

n n sm 2 (|) 

and Fejer's theorem on the Cesaro summability of the Fourier series of the spectral density /. 
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The continuity of the spectral density / at the origin is by no means necessary, and in fact 
Hardy and Littlewood [H Theorem C] in 1924 proved that a necessary and sufficient condition 
is the convergence of 

t 

f(s)ds c G (0,oo). 

-t 

which has appeared before in a probabilistic context (|5J). 

General case, va.r(S n ) ~ K^r^Lin). Necessary conditions usually require restrictive assump- 
tions on the covariances such as regular variation in the Zygmund sense. Several sufficient 
conditions are stated either in terms of the covariances or of the spectral density, e.g. f(x) ~ 
\x\- a L{l/\x\), for a G (0, 1), implies that var(S n ) ~ n 1+a L(n), ([IS]). 

Even when 7 = 1, the asymptotically non-linear behaviour of the variance has appeared often 
in the limit theorems for dependent variables, such as under general mixing conditions (see e.g. 
[TO} IT3] ) or specific models such as random walk in random scenery (see [11] [3]). 
The case 7 > 1 frequently occurs in long-range dependent time-series when the covariances are 
not summable or the spectral density has an appropriate singularity at the origin which often 
results in non-Gaussian limiting behavior (JTSJ [TBI El CEO EES])- The case 7 < 1 occurs when the 
spectral density vanishes at the origin in which case both non-Gaussian ([IS]), and Gaussian 
limits ([15]). have appeared in the literature. 

Technique. It is not clear whether the approach of [9] (and [IS]), can handle the slowly varying 
function and the case 7 7^ 1. We suggest an alternative technique which is based on weak 
convergence and Fourier analysis of tempered distributions which also allows us to work directly 
with spectral measures, without assuming absolute continuity. 

Subsequences. Subsequences var(5 , 2 n)/2 n have often been applied through the use of dyadic 
induction and stationarity, in the context of mixing conditions, martingale approximations, 
central limit theorems, and invariance principles, (|13j). The question whether convergence 
along a subsequence is enough to guarantee convergence of the full sequence has been around 
for some time now, and it was presented to us as a conjecture by M. Peligrad. Although the 
answer is positive under extra conditions such as p-mixing, the necessary and sufficient condition 
stated in Theorem 11.11 allows us to construct a counterexample proving that convergence along 
dyadic subsequences does not imply convergence over the full sequence. 

Proposition 1.2. There exists a stationary process such that var(S , 2' )/2 r converges, but the 
full sequence var(S' n )/n does not. 

The proofs of Theorem 11.11 and Proposition 11.21 are given in the next section along with several 
auxiliary results which are of independent interest. 

2 Proofs 

We start by proving three auxiliary Lemmas. By C we denote a generic positive constant. 
Auxiliary results. Our starting point is the following inequality. 

Lemma 2.1. For any A > 

-L 2 G(l/n) < var(S n ) < G(n) + \ n 2 G{A/n) + tt 2 f ^-dy. 

4 J A/n y A 
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Proof. Define the positive Fejer kernel I n (y) = sin 2 (m//2)/ sin 2 (?//2). To prove the lower bound, 
notice that I n (y) > An 2 /iT 2 for < y < 1/n, and hence 

ptt pl/n A A 

var(£ n ) = / I n (y)G(dy) > / -n 2 G(dy) > - n 2 G(l/n). 
Jo Jo 71 7r 

To prove the upper bound, let A < n and apply the bounds I n (y) < n 2 n 2 /4 ioi y < A/n and 
-^n(|/) < TT 2 /?/ 2 for y > A/n and integration by parts, to derive 

pA/n pn pA/n pn 

var(S n ) = / I n (y)G(dy) + / / n (y)G(dy) < / [nV /4]G(dy) + / [n 2 /y 2 }G(dy) 

Jo J A/n Jo J A/n 

< ^n 2 G(A/n) + G(tt) + vr 2 f ^dy. □ 

The next result establishes that upper bounds of var(5 n )/ g(n), where g{n) = rPLiji) for 7 e 
(0, 2), are equivalent to upper bounds for the spectral measure G. 

Lemma 2.2. Suppose {n k } k >o is a positive non- decreasing integer sequence such that n k — > 00, 
and sup n k+1 /n k = n < 00. Then the following are equivalent: 

1. 3C > and such that var(S' nfe ) < Cg(n k ); 

2. 3C > such that G(x) < Cx 2 ~~ f L(l/x); 

3. 3C > such that vai(S n ) < Cg(n). 

Proof. (1)=^(2). From Lemma 2.1 and our assumptions, we have that for some positive constant 
C > 0, G{l/n k ) < TT 2 Cn1~ 2 L(n k ) / '4. Thus, by monotonicity of G and properties of slowly 
varying functions ([2]), for l/n k+ i < x < l/n k , 

G(x) < G(l/n k ) < —k 2 -^x 2 -~<L(1/x) sup L Wf\ < C'x 2 - 7 L(l/x). 
4 1/ft < A <! L(l/x) 

(2) (3). We apply Lemma O with A = 1 to get 

var(S n ) < G(tt) + ^^ 2 G(l/n) + vr 2 f ^dy < c( 1 + s(n) + f y-^ 1 L{l/y)dy 
4 ii/n r V Jl/n 

Using the change of variables x = 1/y, 



pn pn 

/ y-^ / - 1 L(l/y)dy = / x' y - 1 L(x)dx 

Jl/n Jl/n 



1/n Jl/n 7 

as n — >■ 00 by the Tauberian theorem ([2J Proposition 1.5.8]), since 7 — 1 > —1. Therefore 
there is a constant C such that vai(S n ) < Cg(n) which completes the proof since (3) =>- (1) is 
obvious. □ 

The situation is similar when one considers lower bounds for var(S" n ) and G(x). 

Lemma 2.3. Suppose that there exist positive constants C\ andCi such thatG[x) < CiX 2 ~ 7 L(l / x) 
andv&r(S n ) > C^gin). Thenthere exists apositive constant C3 such thatG(x) > C^x 2 " 7 L(l/x) . 
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Proof. We proceed by absurd and assume that there is a sequence < y k — > such that 
G(yk) 'L{1 /uk) — > 0, as k — > oo. Then we can construct a further sequence 1 < A k — > oo 
slowly enough so that 

A k y k -> , G{A k y k )/y^L{l/y k ) -> , L{l/A m )/L{l/y k ) -> 1 . 

Then, for n& = + 1 — > oo we have by Lemma 12.11 the Tauberian theorem, and the 

monotonicity of G, for generic positive constants C, C > 0, as k — > oo, 

var(S , n J ( 1 n 2 k G(A k /n k ) 



^ C -T^T + tVtV^ + "TTT — \ / ykG(y)dy 
g{n k ) \9{nk) HL(n k ) n y k L(n k ) J Ak/nk 

<r ,( 1 g(A fc y fc ) 

" W"*) Vk^Hl/Vk) AlL(l/y k ) J 

which contradicts assumptions of the lemma. □ 

Remark 2.4. From Lemma [2.11 it is obvious that the converse of Lemma [2.31 is also true. 

Remark 2.5. For the boundary case 7 = 0, Theorem 1 1 . 1 1 does not hold in general. For example, 
for G(x) = x 2 the direct calculations show that var(S' n ) = 41n(n) +0(1) which is not bounded. 
Actually, Robinson [14] proved that 

supvar(S' n ) < oo iff / x~ 2 dG(x) < oo 
n Jo 

When cov(X , X n ) — >■ 0, the Leonov dichotomy holds; either var(5' n ) — > oo or sup n var(5* n ) < oo 
(see Bradley [U Chapter 8]). However, the dichotomy is not true in general even for ergodic 
sequences as it follows e.g. from the Aaronson and Weiss construction [1] on Chacon's ergodic 
transformations. 

A non-ergodic counterexample for Gaussian measures easily follows by taking G({27r2 -fc }) = 
4r k k > 2, and following the calculations similar to Samorodnitsky (see [161 Chapter 5]). More 
exactly, then 

supvar(5 , 2 fc) < oo and supvar(S' n ) = oo . 

k n 

Remark 2.6. For the boundary case 7 = 2, the following dichotomy easily follows from 
Lemma 12.11 

Corollary 2.7. Either timinf n _). ci0 var(S' n )/n 2 > or lim n _^oo var(S n )/n 2 = 0. 

The fact also follows from the von Neumann L2 ergodic theorem which states that E,(S 2 )/n 2 
vanishes if and only if the spectral measure has no atom at the origin (see [6J). 
Also from Lemma I2.1[ the following corollary easily follows. 

Corollary 2.8. Let 7 e (0,2], and {n k } k& z a, non-negative increasing integer sequence such 
that sup k n k+ i/n k < 00. Then the following are equivalent: 

(1) vax(S nk )/nl -> 0; (2) x 2 ^G{x) ->• as < x and (3) var(S n )/n"' ->■ 0. 

Unlike the case 7 = 2, for 7 7^ 2, the equivalence does not hold in general without the assump- 
tion sup fc nk+i/nk < 00 as it follows from Theorem 11.11 by using a slowly varying function L 
such that liminfn^oc L(n) = and lim sup^^ L(n) = 00. 
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Proof of the main results. We are now ready to prove the main results. Let L be a positive 
function slowly varying at infinity, 2 — 7 G (0,2) and g(n) = n 7 L(n). The sufficiency part in 
Theorem 11.11 will be stated as independent Lemma. 

Lemma 2.9. Let G(x) ~ x 2 ~ 7 L(l/x) as x — > 0. Then, lim n ^. 00 vaT(S n ) / g{n) = 1/C(7). 
Proof of Lemma \2.9l Start with the representation 



var(S„) 



M sin 2 f^ r nn/2 sin 2 (v) 

(>J] n 2 G(2dy/n) + / ™ yJ , n 2 G(2dy/n) =: J n>M + J n , M , 



n 2 sin (y/n) 



M n 2 sin (y/n) 



for fixed M < n. 

The inequalities n 2 sin 2 (y/n) > 4y 2 /ir 2 , G(x) < Cx 2 ~ 7 L(l/x), and integration by parts give 



7T 2 r nn/2 vr 2 
J„,m < — / y~ 2 n 2 G{2dy/n) < — 
4 Jm 4 



4^ + C2 3 ~ 7 " 



7T- 



M V 



1+7 



Bounding the integral term by using the change x = n/2y and the Tauberian theorem, we then 
derive 



7T 



Jn,M < —T 



2 7 / n \ 7 ^ / n 
7 vzm/ \2M 



0(l) + 0(^(n/2M)) 



By regular variation g(n/2M)/g(n) — > (2M) 7 and therefore 

+ 0{l/g{n)) + 0{M^). 



var(S n ) I nt M 



g{n) g{n) 

Notice that for y < M < n, sin 2 (y)/n 2 sin 2 (y /n) = sin 2 (y)/y 2 + 0(M 2 /n 2 ), and thus 

I n .M f M sin 2 (y)n 2 -"<G(2dy/n) 



(1) 



g(n) Jo y 2 L(n) 
By regular variation of G, it follows that for y < M 



+ 0(M 2 /n r ). 



n 2 " r G(2y/n) 
L(n)(2M) 2 " 7 ' VM 



2-7 



which defines a probability measure on [0, M] and hence, by weak convergence, since sin 2 (y)/y 2 
is continuous and bounded, there exists a sequence £m{u) — >■ 0, as n — > 00 for all M, such that 



% = 2 2 -(2 - 7) / M ^dy + £ M (n) + 0(M- 

g{n) Jo y +7 



00 sin 2 (|/) 



2 2 " 7 (2 - 7) / r: ^d 2 / + £ M (n) + O(M-r) = (l/<7( 7 )) + £ w (n) + 0(M" 7 ) 



(see [7] for the integral). This together with ([T]) implies the lemma. 



□ 
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Proof of Theorem \l.l[ Implication (2) =>- (1) immediately follows from Lemma [2.91 

For (1) =>- (2), let tj — > oo be a positive increasing integer sequence. Similar to Lemma [2. 9[ we 

derive 

wts,) _ r + 0(MVi7) + 0{M . iy 



g(tj) Jo y 2 L{tj) 

For y < M we have 

t 2 ~ 1 G(2M/tj) _ L(tj2M) 

L(tj) ~ L[tj) ~ 

Helly's principle and a diagonal argument imply that there exists a monotone increasing function 
h, defined on [0, oo), and a subsequence f such that 

t 2 7 7 G(2y/t r ) 

as j' —7- oo for all continuity points y of /i. Since h(y) < CM 2-7 for y < M, and sin 2 (y)/|/ 2 is 
continuous and bounded on [0, M], by weak convergence we have that 

^sin 2 ^ /^sin 2 ^),,, N 

o y Jo y 

Therefore, writing an identity for arbitrary M > and then letting M — > oo 

var(5 t ,) f M S m 2 (v) f 00 sm 2 (v) 

K ° = ^^f = l -^Wo(*o = / —Mk(d y ). 

Let [x] denote the integer part of x, and notice that from fl2]) and regular variation of G, we 
also have 

F([^])= ^y^ r^ % /r), 

as j' — >■ oo for arbitrary r > and all continuity points y/r of /i. Since var(S n ) / g(n) converges 
on the full sequence, it follows that 

= l im /r I n = / — r y h(dy r), 

j'^oc g{[rt f \) J y 2 

for any r > 0, implying that 

" ^M^(dx) = r^ . (3) 

ar 

For y > 0, let ip(y) '■— linijv-i.00 jy x~ 2 h(dx), which is well defined since by integration by parts 
we have 

97/1 \ L f N h(x)-h(y)^ ] n f co h(x)-h(y)^ 

I x~ 2 h(dx) = lim 2 / v ; - yy/ dx = 2 / v ; - yy 1 dx < 00. 

Jy N ^°° Jy X A J y X 6 
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The idea is to identify ip from its Fourier transform using the convolution type equation (J3]); 
along these lines we continue by calculating the sine-transform of if) by interchanging the inte- 
grals, which is allowed since the positive function i[) is bounded away from and < Cy~ J , 

/ sm(ry)^(y)dy = (/ sm(ry)^-^)dy = - ^fJ. h (dx) + - K -^h{dx) 

JO JO x Jx=y A / 'Jo ' J a x 

~^ (o) 7 K o = lim / sin(ry)ip(y)dy 

Z a— >oo Jq 

as a — )• 00 for all r > 0. 

For y < 0, we define ^(y) = — t/>(— y) so that for any relwe have 

lim / sm(ry)ip(y)dy = 2 2-7 sgn(r)|r| 7-1 lfo- (4) 

a— >oo / 

J —a 

To identify the function ip and therefore h, we apply the Fourier analysis and treat if) as a distri- 
bution acting on the Schwartz space of test functions S = S(M) such that sup a . \x a <pn\x)\ < oo 
for all non-negative integers a, (3. More exactly, we define a linear functional on S by 



*[</>] = / ^(y)(0(y)-0(-y))dy, 

Jo 

which is continuous since 

\*[<f>]\ <4swp\4>'(y)\( I if>(y)ydy) + 4sup |#(y)| ( I (if;(y)/y)dy 
y x Jo J y x Ji 

< C^(sup \<f/(y) \ + sup \y<f>(y)\) 
y y 

The next step is to calculate the Fourier transform of the tempered distribution through the 
formula iff[<f>] = ^ [</>]• Then given <f> e S we have 

poo . poo . /»oo . /»oo . 

= / ( / (e % - e^^df )dy = i / if>{y) ( / sin(yt)0(t)dt)dj/ 

</j/=0 V Jt=-oo / Jy=-oo V Jt=-oo / 

Observe that | sm{yt)\ < \yt\, \ip{y)\ < C|y| -7 , and 1 — 7 > —1 and so for fixed a 

/a poo pa poo 

/ |V^)||sin(y*)|0(O|dtdy< / / | 2/ | 1 - 7 |t0(t)|dtd 2 /<oo . 
-a J — 00 J —a J —00 

Therefore by Fubini's theorem 

/a poo poo pa 

tp(y) / sm(yt)<fi(t)dtdy = i lim / 4>{i) I ip(y) sm(yt)dydt 
It a— >oo / / 
■a Jt=—oo J —00 J y=—a 

We next bound the integrand in order to use dominated convergence. Let r = [ta/n], and write 

pa j />ta 

I ■= 4>(y) sin(yt)dy = - / sin(x)-?/'(x/t)da; 

7y=0 ^ 7a;=0 

t-1 "0'+l)7T J /-to 

j=0 



- / sin(:r)-?/>(a;/t)da; H — / sin(:r)-?/>(a;/t)da;. 
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Since ttt is the largest multiple of 7r less than ta, for x G [tit, ta] sin(x) does not change sign 
and therefore 



ta 



sin(x)ip(x/t)dx 



ta 



sin 


»\ 


\x 


7 



dx < Clt^- 1 . 



The other term can be written as an alternating sum 

T-l -(i+l)7T 



Q:=- / I sin ( x ) \^{x/t)dx. 



From the fact that i/j is decreasing we can then show that 



Cj :-- 



sm(x)\ip(x/t)dx > 



sin 



»|V(0' + lW*)dz 



sm 



(i + l)7T 



»^(0' + l)7r/t)da;> 



(j+2)n 



(j + l)7T 



sm 



x)|?/'(a;/t)dx 



Cj+l, 



and thus the sum Q is conditionally convergent and in absolute value less than its first term, 



\Q\< 



sin(x)if)(x/t)dx 



sia(x)ip(x/t)dx < 



c r t 1 

sin fx) — dx = Ct 7-1 . 



Overall the above calculations imply that for all a > 



<p(t) I sm(yt)i>(y)dy 

y=—a 



<C\<j>(t)\P-\ 



where C does not depend on a. Furthermore since 7 — 1 > —1, the function |0(t)|t 7_1 has 
at most an integrable singularity at the origin and is integrable. Therefore by dominated 
convergence and (J4]) 

/oo / pa \ poo / \ 

^t)^\\mj ^(y)sm(yt)dyjdt = J ( j ) (t)(i2 2 ^K sgn(t)\t\'<- l jdt. 

Then inverting the Fourier transform of the distribution ^ (see [7j for example) we identify the 
function ip(y), and by standard calculations h(x), for x,y > 0, 7 G (0,2) 

ip(y) = K D(-f)y-^, h(x) = (7/(2 - -f))K D(-f)x 2 ^ , where £(7) = r( 7 )2 2 ~ 7 sin(77r/2)/7r . 

We have shown that for every integer sequence tj — > 0, there exists a subsequence tj> —> 00 such 
that for x, r > and 7 G (0, 2) 



[rVp G (*/K,]) 



-)• r 2 - 7 /i(a;/2r) = (7/(2 - 7 ))ir 0J D(7)(a;/2) 2 " 7 



From this by standard limiting arguments we now deduce that 

G{x) 



lim , 

x^o x 2 -~fL(l/x) 

which proves the Theorem. 



(7/(2 - 7 ))^(7)(l/2) 2 " 7 = C(i)K 



□ 



S 



Proof of Proposition II . ,81 The proof is through a counterexample. Let G(x) = 2~ k , for x G 
(2~( fc+1 ) , 2~ k ], for k > 1. Then obviously lim^o G(x)/x does not exist, as different subsequences 
give different limits. Therefore by Theorem II .11 the limit of the full sequence var(S* n )/n cannot 
exist. 

On the other hand, by direct calculation on the subsequence 2 r , 

^1 = ± ^(2^-1)2*1- £ ^) + £ 2 * sin2(2 - fe) G (o, oo). 

fc=l fc=0 k=l 

completing the proof of the proposition. □ 

Acknowledgements. We would like to thank Prof. M. Peligrad and Prof. R. Bradley for useful 
discussions. 
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